Projector and method of controlling projector

ABSTRACT

A projector includes a manipulation detecting unit that performs a manipulation detecting process on the basis of captured image data of an imaging unit, and a correction control unit that performs a distortion correcting process on the basis of the captured image data. An imaging control unit sets an image-capturing resolution of the imaging unit to resolutions different from each other between a case where the manipulation detecting unit performs the manipulation detection process and a case where the correction control unit performs the distortion correcting process.

The entire disclosure of Japanese Patent Application No. 2013-239537,filed Nov. 20, 2013 is expressly incorporated by reference herein.

BACKGROUND

1. Technical Field

The present invention relates to a projector that projects an image on aprojection surface, and a method of controlling a projector.

2. Related Art

In the related art, in projectors that project an image onto aprojection surface, a projector that captures a projected image is known(for example, refer to JP-A-2009-64110). For example, a device describedin JP-A-2009-64110 detects a manipulation of the projected image byperforming a process of extracting a difference between a plurality ofcaptured images.

In a case of performing the detection of the manipulation and the likeon the basis of the captured images, if a resolution is increased, aminute variation in an image-capturing range can be detected, and thushigh-accuracy processing can be performed. However, since an amount ofdata of the captured images increases, a processing load increases.Accordingly, a countermeasure such as securement of a hardwareperformance capable of supporting image processing with a high load isnecessary.

SUMMARY

An advantage of some aspects of the invention is to suppress an increasein a processing load and to realize high-accuracy processing on thebasis of a captured image by using a projector that performs processingon the basis of the captured image.

An aspect of the invention is directed to a projector including: animaging unit which captures an image of a projection surface; a firstprocessing unit which detects a manipulation performed on the projectionsurface on the basis of an image-capturing result of the imaging unit,and performs a first process corresponding to the manipulation that isdetected; a second processing unit which performs a second processdifferent from the first process on the basis of the image-capturingresult of the imaging unit; and a control unit which sets animage-capturing resolution of the imaging unit to resolutions differentfrom each other between a case where the first processing unit performsthe first process, and a case where the second processing unit performsthe second process.

According to the aspect of the invention, it is possible to set theimage-capturing resolution of the imaging unit to be suitable for aprocess that is performed on the basis of the image-capturing result.For example, in a case of performing a process in which a high-accuracycaptured image is necessary, the image-capturing resolution can be setto a high resolution, and in a case of performing processing in which ahigh-accuracy captured image is not necessary, the image-capturingresolution can be set to a low resolution. According to this,high-accuracy processing based on the image-capturing result can beperformed, and it is possible to suppress an increase in a processingload.

Another aspect of the invention is directed to the projector describedabove, wherein the control unit performs control of switching a firstoperation state in which the projector performs the first process by thefirst processing unit, and a second operation state in which theprojector performs the second process by the second processing unit, andwhen the first operation state and the second operation state areswitched to each other, the image-capturing resolution of the imagingunit is changed.

According to the aspect of the invention, since the operation states, inwhich the first process and the second process are performed, areswitched, and the image-capturing resolution is changed in theswitching, it is possible to perform the first process and the secondprocess with a resolution suitable for each of the processes.

Still another aspect of the invention is directed to the projectordescribed above, wherein the first process that is performed by thefirst processing unit includes a detection process of detecting anindication manipulation on the projection surface.

According to the aspect of the invention, it is possible to perform thedetection process of detecting the indication manipulation on theprojection surface on the basis of an image-capturing result with asuitable resolution.

Yet another aspect of the invention is directed to the projectordescribed above, wherein the second process that is performed by thesecond processing unit includes a process of correcting distortion of aprojection image that is projected onto the projection surface.

According to the aspect of the invention, in a case of correctingdistortion of the projection image on the basis of the image-capturingresult of the imaging unit, an image-capturing resolution suitable forthe distortion correction is set, and thus it is possible to correct thedistortion with high accuracy. In addition, in a case of performing thefirst process that is different from the second process, if theimage-capturing resolution is set to a relatively low resolution, it ispossible to reduce a processing load. According to this, it is possibleto suppress an increase in a processing load while realizing distortioncorrection with high accuracy.

Still yet another aspect of the invention is directed to the projectordescribed above, wherein the first process that is performed by thefirst processing unit includes a determination process of determiningwhether or not the indication manipulation detected in the detectionprocess corresponds to a manipulation that is set in advance, and thecontrol unit sets the image-capturing resolution of the imaging unit ina case where the first processing unit performs the first process at aresolution lower than a resolution in a case where the second processingunit performs the second process.

According to the aspect of the invention, it is possible to perform aprocess of detecting the indication manipulation on the projectionsurface and determining whether or not the indication manipulationcorresponds to a process that is set in advance with high speed by usinga low-resolution image-capturing result. In addition, it is possible toperform the second process, which is different from the determinationprocess on the basis of an image-capturing result with a relatively highresolution.

Further another aspect of the invention is directed to a method ofcontrolling a projector. The method includes: controlling a projectorincluding an imaging unit that captures an image of a projectionsurface; and setting an image-capturing resolution of the imaging unitto resolutions that are different from each other between a case ofdetecting a manipulation performed on the projection surface on thebasis of an image-capturing result of the imaging unit and performing afirst process corresponding to the manipulation that is detected, and acase of performing a second process different from the first process onthe basis of the image-capturing result of the imaging unit.

According to the aspect of the invention, it is possible to set theimage-capturing resolution of the imaging unit to be suitable for aprocess that is performed on the basis of the image-capturing result.For example, in a case of performing a process in which a high-accuracycaptured image is necessary, the image-capturing resolution can be setto a high resolution, and in a case of performing processing in which ahigh-accuracy captured image is not necessary, the image-capturingresolution can be set to a low resolution. According to this,high-accuracy processing based on the image-capturing result can beperformed, and it is possible to suppress an increase in a processingload.

According to the aspects of the invention, high-accuracy processingbased on image-capturing results can be performed, and an increase in aprocessing load can be suppressed.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention will be described with reference to the accompanyingdrawings, wherein like numbers reference like elements.

FIG. 1 is a block diagram illustrating a configuration of a projectoraccording to an embodiment.

FIGS. 2A to 2D are explanatory diagrams illustrating an operationexample corresponding to a position indicating manipulation.

FIG. 3 is a flowchart illustrating an operation of a projector.

DESCRIPTION OF EXEMPLARY EMBODIMENTS

Hereinafter, an embodiment to which the present invention is appliedwill be described with reference to the attached drawings.

FIG. 1 is a block diagram illustrating an overall configuration of aprojector 100 according to this embodiment. The projector 100 projectsan image onto a screen SC (projection surface) on the basis of imagedata that is stored in a built-in image storage unit 171. In addition,the projector 100 may project an image onto the screen SC on the basisof image data that is input from an external image supply device (notshown) such as a personal computer and various video players. The imagedata may be moving picture (video) data or still image data.

In this embodiment, a configuration in which the projector 100 performsfront surface projection with respect to the screen SC provided with areflection curtain is exemplified. The screen SC stands substantiallyupright, and a screen surface has a rectangular shape. In addition, asthe projection surface onto which the projector 100 projects an image, awall surface, a ceiling surface, or a bottom surface of a building maybe used. In addition, the screen SC may be provided with a transmittingtype curtain, and the projector 100 may project an image from a rearsurface of the screen SC.

A main body of the projector 100 includes a projection unit 101 thatforms an optical image.

The projection unit 101 includes a light source 140, an opticalmodulator 130, and a projection optical system 150. As the light source140, a xenon lamp, an ultrahigh pressure mercury lamp, a light emittingdiode (LED), a laser light source, and the like may be used. Inaddition, the projection unit 101 may include a reflector that guideslight beams emitted from the light source 140 to the optical modulator130, a dimming unit (not shown) that dims the light beams emitted fromthe light source 140, and the like.

The optical modulator 130 modulates the light beams emitted from thelight source 140 and generates image light. In the optical modulator130, for example, a method of using three sheets of transmissive liquidcrystal light valves corresponding to respective colors of RGB may beemployed. In this case, the light beams emitted from the light source140 are separated into respective colored light beams of R, G, and B bya dichroic mirror and the like, and are incident to the opticalmodulator 130. In addition, the three colored light beams are modulatedby a three-color liquid crystal panel provided to the optical modulator130, and the modulated light beams are composed by a cross dichroicprism. The optical modulator 130 is driven by an optical modulator driveunit 134, and optical transmittance at respective pixels arranged in amatrix shape is changed to form an image.

The projection optical system 150 includes a zoom lens 151 that performsenlargement, reduction, and focus adjustment of an image that isprojected, a zoom adjusting motor 152 that adjusts a degree of zooming,and a focus adjusting motor 153 that performs focus adjustment. Theprojection optical system 150 projects the light beams, which aremodulated by the optical modulator 130, onto the screen SC. According tothis, a projection image is imaged on the screen SC. The zoom lens 151is constituted by a lens group including a plurality of lenses, and thezoom adjusting motor 152 and the focus adjusting motor 153 drive thelens group of the zoom lens 151. According to this operation,enlargement, reduction, and focus adjustment of the projection image onthe screen SC are performed.

In addition, the main body of the projector 100 includes an imageprocessing system that controls all operations of the projector 100 andelectrically processes image signals. The image processing systemincludes a CPU 120 that controls the entirety of the projector 100, animage processor 131, a RAM 160, and a ROM 170. The CPU 120 executes aprogram stored in the ROM 170, to realize a control function and animage processing function.

The RAM 160 forms a work area that temporarily stores a program executedby the CPU 120 or the image processor 131, or data. In addition, theimage processor 131 may include a work area, which is necessary whenperforming respective processes such as an image display state adjustingprocess performed by the image processor 131 itself, as a built-in RAM.

The ROM 170 stores a program that is executed by the CPU 120, and datathat is processed by the program executed by the CPU 120. In addition,the ROM 170 includes the image storage unit 171, a set value storageunit 172, and a condition storage unit 173.

In addition, the image processing system of the projector 100 includesthe optical modulator drive unit 134, alight source drive unit 141, alens drive unit 154, an imaging unit 180, a captured image memory 182, amovement detecting unit 185, a remote controller control unit 190, aremote controller 191, and a manipulation unit 195. The CPU 120, theimage processor 131, and the above-described respective components areconnected to each other by a bus 102.

An I/F (interface) 110 is connected to the image processor 131. Imagedata is input to the I/F 110 from the above-described external imagesupply device (not shown). The I/F 110 includes a connector that iswire-connected to the image supply device, or a wireless communicationdevice that performs wireless communication with the image supplydevice. A plurality of image supply devices may be connected to the I/F110, and image data of a plurality of systems is input to the I/F 110.The I/F 110 switches the input systems of the image data in accordancewith control of the CPU 120, and outputs image data to the imageprocessor 131. In this embodiment, image data of two systems includinginput systems IN1 and IN2 is input to the I/F 110.

The I/F 110 is a digital interface to which digital image data(including digital video data) is input and which outputs the digitalimage data to the image processor 131. The I/F 110 may have a functionof performing a data converting process such as frame conversion,resolution conversion, and 3D/2D conversion of the image data input fromthe input systems IN1 and IN2. In addition, the I/F 110 may have an A/D(analog/digital) converting function, and thus analog video signals maybe input to the I/F 110 from the image supply device.

The CPU 120 includes a projection control unit 121, a correction controlunit 122, a zoom ratio calculating unit 123, a focal length calculatingunit 124, a three-dimensional measurement unit 125, a projection anglecalculating unit 126, a manipulation detecting unit 127, and an imagingcontrol unit 128. These respective units are realized when the CPU 120executes a program stored in the ROM 170. The function of the respectiveunits of the CPU 120 will be described later.

The image processor 131 includes a trapezoidal distortion correctingunit 132 and an overlapping processing unit 133. The image processor 131processes image data input from the I/F 110 in accordance with controlof the CPU 120 to generate image signals, and outputs the image signalsto the optical modulator drive unit 134. In addition, in a case wherethe projector 100 projects image data that is stored in the imagestorage unit 171, the image processor 131 performs the above-describedprocessing with respect to the image data.

As the image processor 131, a general-purpose processor available on themarket as a digital signal processor (DSP) for trapezoidal distortioncorrection or image processing may be used, or a dedicated ASIC may beused.

The trapezoidal distortion correcting unit 132 corrects an image inaccordance with control of the CPU 120 on the basis of parameters forcorrection which are input from the CPU 120. The trapezoidal distortioncorrecting unit 132 corrects trapezoidal distortion of a projectionimage that is projected onto the screen SC by the projector 100, andoutputs image data after correction to the overlapping processing unit133.

The overlapping processing unit 133 performs a process of overlapping amanipulation menu screen and the like of the projector 100 as an OSDimage on the image data corrected by the trapezoidal distortioncorrecting unit 132. The overlapping processing unit 133 generates imagesignals for display of the image data after processing, and outputs theimage signals to the optical modulator drive unit 134.

In addition, the image processor 131 may perform a process of adjustingan image display state such as brightness, contrast, depth of color, andcolor tone with respect to image data that is input from the I/F 110 byusing the functions of the trapezoidal distortion correcting unit 132and the overlapping processing unit 133.

The optical modulator drive unit 134 drives the optical modulator 130 onthe basis of image signals that are input from the image processor 131.According to this, an image based on the image data that is input to theI/F 110 is formed in an image forming region of the optical modulator130. The image that is formed in the optical modulator 130 is formed onthe screen SC as a projection image through the projection opticalsystem 150.

The light source drive unit 141 applies a voltage to the light source140 in accordance with instruction signals that are input from the CPU120 to turn on and turn off the light source 140.

The lens drive unit 154 drives the zoom adjusting motor 152 and thefocus adjusting motor 153 in accordance with control of the CPU 120 toperform zoom adjustment and focus adjustment.

The imaging unit 180 includes a CCD camera 181 using a CCD that is aknown image sensor, and a camera lens 183 that is disposed in front ofthe CCD camera 181. In addition to the CCD, the CCD camera 181 includesperipheral circuits (not shown) such as a control circuit that reads outimage signals from the CCD. The imaging unit 180 is provided on a frontsurface side of the projector 100, that is, at a position capable ofcapturing an image in a direction, in which the projection opticalsystem 150 projects an image toward the screen SC, by the CCD camera181. That is, the imaging unit 180 is provided to capture an image inthe same direction as the projection direction of the projection opticalsystem 150. An image-capturing direction and an angle of view of the CCDcamera 181 are set in such a manner that the entirety of the projectionimage that is projected onto the screen SC with a recommended projectiondistance enters at least an image-capturing range.

Data of the captured image that is captured by the CCD camera 181 isoutput from the imaging unit 180 to the captured image memory 182, andis recorded in a predetermined region of the captured image memory 182.When writing of image data for one screen is completed, the capturedimage memory 182 sequentially inverts a flag of a predetermined region,and thus the CPU 120 can determine whether or not image-capturing withthe imaging unit 180 is completed with reference the flag. The CPU 120accesses the captured image memory 182 with reference to the flag andacquires necessary captured image data.

The movement detecting unit 185 includes a gyro sensor or anacceleration sensor, detects movement of the main body of the projector100, and outputs a detected value to the CPU 120. A threshold value isset in advance for the detected value of the movement detecting unit185. In a case where movement exceeding the threshold value is detectedby the movement detecting unit 185, the CPU 120 determines that theprojector 100 has moved. In addition, in a case where the movementdetected by the movement detecting unit 185 is equal to or less than thethreshold value and this state continues beyond a standby time that isset in advance, the CPU 120 determines that the projector 100 isstopped.

In addition, the following configuration is also possible. Specifically,a threshold value may be set to the movement detecting unit 185, and ina case where the detected value of the movement detecting unit 185exceeds the threshold value and in a case where the detected value ofthe movement detecting unit 185 is equal to or less than the thresholdvalue and a standby time has been elapsed, the movement detecting unit185 may output detection signals to the CPU 120. In this case, it ispossible to reduce a processing load of the CPU 120.

In addition, the movement detecting unit 185 may detect the movement onthe basis of a variation of the captured image of the imaging unit 180.In this case, the movement detecting unit 185 acquires captured imagedata from the captured image memory 182, compares the acquired capturedimage data and captured image data which is captured at a differenttime, and detects movement in a case where a difference between the twopieces of captured image data is equal to or more than a predeterminedvalue. In this case, it is possible to detect the movement by using theimaging unit 180.

The remote controller control unit 190 receives wireless signalstransmitted from the remote controller 191 outside the projector 100.The remote controller 191 includes manipulation elements (not shown)that are manipulated by a user, and transmits a manipulation signalcorresponding to manipulation with respect to the manipulation elementsas a wireless signal such as an infrared signal. The remote controllercontrol unit 190 includes a reception unit (not shown) that receives theinfrared signal and the like. The remote controller control unit 190receives signals transmitted from the remote controller 191, analyzesthe signals to generate signals indicating the content of themanipulation by the user, and outputs the generated signals to the CPU120.

For example, the manipulation unit 195 is constituted by manipulationelements (not shown) of a manipulation panel that is disposed at themain body of the projector 100. When detecting a manipulation withrespect to the manipulation elements, the manipulation unit 195 outputsmanipulation signals corresponding to the manipulation elements to theCPU 120.

The projection control unit 121 that is provided to the CPU 120 controlsan image projection operation performed by the projection unit 101 onthe basis of image data that is output from I/F 110. The projectioncontrol unit 121 performs control of turning on and turning off thelight source 140 by the light source drive unit 141 in accordance withpower on/off of the projector 100, control of allowing the image dataoutput from the I/F 110 to be processed by the image processor 131, andthe like.

The correction control unit 122 controls the trapezoidal distortioncorrecting unit 132, and allows the trapezoidal distortion correctionunit 132 to perform a distortion correcting process (second process) ofcorrecting trapezoidal distortion. The correction control unit 122functions as a second processing unit in cooperation with thetrapezoidal distortion correction unit 132.

The correction control unit 122 acquires captured image data from thecaptured image memory 182, and analyzes a shape of the captured imagedata to calculate parameters that are used to correct distortion of aprojection image. Here, the correction control unit 122 may project apattern for correction (not shown), which is stored in the ROM 170, ontothe screen SC by the control of the projection control unit 121. In thiscase, the correction control unit 122 extracts a pattern for correctionfrom the captured image data of the imaging unit 180, and analyzes ashape of the pattern for correction to calculate parameters. Thecorrection control unit 122 outputs the parameters that are calculatedto the trapezoidal distortion correcting unit 132 in order for thetrapezoidal distortion correction unit 132 to perform trapezoidaldistortion correction in accordance with the parameters.

The zoom ratio calculating unit 123 calculates a zoom ratio forenlargement or reduction of the projection image by the zoom lens 151 incorrespondence with a manipulation of the remote controller 191 or amanipulation in the manipulation unit 195. The projection anglecalculating unit 126 calculates an inclination of an optical axis of thezoom lens 151 with respect to a plane of the screen SC, that is, aprojection angle on the basis of the captured image data stored in thecaptured image memory 182. In addition, the three-dimensionalmeasurement unit 125 analyzes the captured image data stored in thecaptured image memory 182 on the basis of the zoom ratio calculated bythe zoom ratio calculating unit 123 and the projection angle calculatedby the projection angle calculating unit 126 to calculate a distance(projection distance) from a reference position of the zoom lens 151 tothe screen SC. The focal length calculating unit 124 calculates anamount of drive of the focus adjusting motor 153 on the basis of thedistance calculated by the three-dimensional measurement unit 125 tocontrol the lens drive unit 154, and performs focus adjustment.

The correction control unit 122 calculates parameters for correction onthe basis of the projection distance, the projection angle, and the likewhich are calculated by the zoom ratio calculating unit 123, the focallength calculating unit 124, the three-dimensional measurement unit 125,and the projection angle calculating unit 126. The parameters areparameters to deform an image that is drawn by the optical modulator 130so as to compensate distortion of the projection image on the screen SC.For example, the parameters are parameters including a plurality ofpieces of data which define a direction of the deformation, an amount ofthe deformation, and the like. The correction control unit 122 storesthe parameters in the ROM 170 in combination with other calculationresults and the like.

The manipulation detecting unit 127 (first processing unit) performs amanipulation detecting process (first process) to detect a positionindicating manipulation that is performed on the screen SC by anindicator. The position indicating manipulation is a manipulation withwhich the indicator indicates a position in an angle of view of theimaging unit 180 during an operation of the projector 100. A specificaspect of the indicator is not limited as long as the indicator can becaptured in the captured image data of the imaging unit 180 anddistinguish the projection image of the projector 100. For example, theindicator may be a rod-shaped device that is used by a user by hand, ormay be instruments having other shapes. The device or instruments mayhave a light-emitting function or a wireless signal transmittingfunction, and may not have these kinds of functions. In addition, a partof the user's body (for example, hand or finger) may also be theindicator. In addition, the indicator may be a bright spot that isformed on the screen SC when the screen SC is irradiated with lightbeams by a light-emitting device (not shown) such as a laser pointer.

The manipulation detecting unit 127 detects that the position indicatingmanipulation has been performed on the basis of the captured image datastored in the captured image memory 182. The manipulation detecting unit127 may specify a position indicated by the indicator during themanipulation detecting process and may output coordinates of theindicated position. In addition, the manipulation detecting unit 127 candetect the manipulation position indicated by the position indicatingmanipulation during the manipulation detecting process, and candetermine whether or not the detected position corresponds to acondition that is set in advance. In addition, the manipulationdetecting unit 127 can determine whether or not a trajectory of thedetected position corresponds to a condition that is set in advance.Here, the trajectory of the position represents a diagram that is formedby connecting indicated positions in a plurality of times of positionindicating manipulations which are detected by the manipulationdetecting unit 127 with a time interval. The condition with which themanipulation detecting unit 127 performs determination is stored in thecondition storage unit 173 of the ROM 170. In the condition storage unit173, the condition with which the manipulation detecting unit 127performs determination, and a process to be performed when detecting amanipulation corresponding to the condition are set in correlation witheach other.

In this embodiment, indication of a specific position on the screen SCby the indicator is set as a condition, and switching of an input sourceis performed as an operation in a case of detecting a manipulationcorresponding to the condition. The switching of the input sourcerepresents an operation of switching image supply devices (image source)that are connected to the I/F 110. Specifically, the switching of theinput source represents an operation of switching the input system IN1and the input system IN2 by the I/F 110 in accordance with the controlof the CPU 120.

FIGS. 2A to 2D are explanatory diagrams illustrating an operationexample corresponding to a position indicating manipulation.

In a state shown in FIG. 2A, a projection image 61 is projected onto thescreen SC. The projection image 61 is an image that is projected on thebasis of image data input from the input system IN1 of the I/F 110. Thatis, in the state of FIG. 2A, the I/F 110 selects the input system IN1.The projection image 61 includes an object 62.

When a detection operation of detecting the position indicatingmanipulation is initiated, the manipulation detecting unit 127 controlsthe overlapping processing unit 133 so as to project the projectionimage 61 on which an image 63 for detection is overlapped. Theoverlapping processing unit 133 overlaps an image of the image 63 fordetection, which is stored in the ROM 170 in advance, on an image inputfrom the trapezoidal distortion correcting unit 132, and performsdrawing by using the optical modulator drive unit 134. According tothis, the image 63 for detection is projected onto the screen SC. Theimage 63 for detection is disposed at an end of the screen SC at whichthe image 63 for detection is less likely to block the object 62 and amanipulation is easy. In an example of FIG. 2A, the image 63 fordetection has an approximately rectangular shape having a size that isset in advance.

The manipulation detecting unit 127 specifies a position and a size ofthe image 63 for detection on the captured image. For example, themanipulation detecting unit 127 acquires the position and the size ofthe image 63 for detection on a panel (an image forming region of theoptical modulator 130) by reading out the position and the size from theROM 170 or by calculating the position and the size. For example, dataindicating the position and the size in a case of overlapping the image63 for detection on the input image, or data indicating the position andthe size of the image 63 for detection on the panel may be stored in theROM 170 in combination with image data of the image 63 for detection.

In addition, the manipulation detecting unit 127 derives the positionand the size of the image 63 for detection on the captured image fromthe position and the size of the image 63 for detection on the panel onthe basis of at least one or more parameters among a position of thepattern for correction in the captured image, the projection distanceand the projection angle which are calculated by the three-dimensionalmeasurement unit 125 and the projection angle calculating unit 126, anda correction amount (parameter for correction) of distortion in theprojection image. In addition, the position of the image 63 fordetection on the captured image may be specified by acquiring adifference of the captured image before and after display of the image63 for detection, or may be specified by pattern matching.

The manipulation detecting unit 127 sets an overlapping range with theimage 63 for detection as a detection region. The manipulation detectingunit 127 specifies an indication position of the indicator on the basisof the captured image data of the imaging unit 180, and in a case wherethe indication position is in the detection region, the manipulationdetecting unit 127 determines that a specific manipulation is made.

As an example, a description will be given to a case in which the handof the user is used as an indicator 2.

In a state in which the image 63 for detection is projected, when theindicator 2 is overlapped on the image 63 for detection as shown in FIG.2B, the manipulation detecting unit 127 determines that the indicator 2is overlapped on the image 63 for detection on the basis of the capturedimage data of the imaging unit 180. When the indicator 2 is overlappedon the image 63 for detection, light beams projected from the projectionunit 101 are blocked by the indicator 2 in front of the screen SC.According to this, in the captured image data of the imaging unit 180,the brightness, color, appearance, and the like of the image 63 fordetection vary at a portion at which the indicator 2 is overlapped onthe image 63 for detection. The manipulation detecting unit 127 extractsan image of the image 63 for detection, that is, an image of thedetection region from the captured image data and analyzes the image todetect a variation in brightness or color, and determines whether or nota manipulation of the indicator 2 has been performed.

The manipulation detecting unit 127 may specify the position of theimage 63 for detection on the basis of the position of the pattern forcorrection which is projected by the correction control unit 122 and thecorrection amount (parameter) of distortion. In this case, it ispossible to detect the manipulation by specifying the position of theimage 63 for detection in a more accurate manner. In addition, afteracquiring the captured image data of the imaging unit 180 from thecaptured image memory 182, the manipulation detecting unit 127 may onlyextract the image 63 for detection which is the detection region, and animage of the periphery of the image 63 for detection, and may analyzethe extracted image. In this case, it is possible to reduce an amount ofdata that is processed in the process of extracting the image of theindicator 2 and the process of comparing the image of the image 63 fordetection by the manipulation detecting unit 127, and the like, and thusit is possible to reduce a processing load.

For example, a condition for the manipulation detecting unit 127 todetermine whether or not the manipulation is performed with respect tothe image 63 for detection is as follows.

In the case where the indicator 2 is present on the image 63 fordetection (detection region) for a time period that is set in advance ormore, the manipulation detecting unit 127 determines that themanipulation has been performed. Specifically, in a case where any oneof the following Expression (1) and Expression (2) are continuouslysatisfied for a time period set in advance or more with respect to atleast partial pixels in the detection region in the captured image data,the manipulation detecting unit 127 determines that the manipulation hasbeen performed.Luminance value of pixel>First threshold value  (1)Luminance value of pixel<Second threshold value  (2)

In addition, the manipulation detecting unit 127 may extract an image ofthe image 63 for detection from the captured image data, and may comparethe extracted image of the image 63 for detection with an image of theimage 63 for detection in captured image data during non-manipulation todetect a variation in a shape of the image of the image 63 fordetection. In this case, in a case where the variation in the shape ofthe image 63 for detection is established for a predetermined time, themanipulation detecting unit 127 determines that the manipulation hasbeen performed.

In addition, the manipulation detecting unit 127 may extract the imageof the indicator 2 from the captured image data, and may compare theposition of the image of the indicator 2 and the position of the image63 for detection to determine whether or not the manipulation has beenperformed with respect to the image 63 for detection.

The condition, and the first and second threshold values necessary fordetermination of the condition or data relating to the position, size,shape, and the like of the image 63 for detection are set in advance andare stored in the condition storage unit 173.

In addition, in a case where the manipulation detecting unit 127performs the above-described determination, a situation in which atleast a part of the image 63 for detection appears in the captured imagedata may be set as the condition. In this case, for example, it ispossible to distinguish between a situation in which a user or a personother than the user stands in the vicinity of the imaging unit 180 or inthe vicinity of the image 63 for detection and thus the image 63 fordetection is hidden, and the manipulation by the indicator 2. Inaddition, in a case where the image 63 for detection is intentionallymanipulated by the indicator 2, the manipulation is detected, and thusit is possible to prevent an unintended mal-manipulation from beingdetected.

As shown in FIG. 2B, in a case where the manipulation of the image 63for detection by the indicator 2 is detected, the manipulation detectingunit 127 performs an operation that is set in advance in correlationwith the manipulation. In this embodiment, as described above, thesource switching is performed, and the manipulation detecting unit 127controls the I/F 110 to perform switching from the input system IN1 tothe input system IN2.

According to this, as shown in FIG. 2C, an image that is projected ontothe screen SC is switched from the projection image 61 of the inputsystem IN1 to a projection image 65 of the input system IN2. Theprojection image 65 is an image including an object 66.

When the manipulation detecting unit 127 continuously performs themanipulation detecting process, even after the switching from theprojection image 61 to the projection image 65, as shown in FIG. 2C, theimage 63 for detection is projected. Here, as shown in FIG. 2D, when amanipulation by the indicator 2 is performed with respect to the image63 for detection, the manipulation detecting unit 127 detects themanipulation and switches the source of the I/F 110.

In FIGS. 2A to 2D, an example in which only one image 63 for detectionis projected onto the screen SC is described. However, the number ofdetection regions is arbitrary, and for example, a plurality ofdetection regions may be set, and images for detection, which representrespective detection regions, may be projected. In this case, the sameoperation may be correlated with the respective detection regions, ordifferent operations may be correlated with the respective detectionregions. That is, in a case where a manipulation with respect to any oneof the plurality of detection regions is detected, one operation that isset may be performed, or an operation correlated with a detection regionin which the manipulation is detected may be performed. In addition,operations that are correlated with combinations of a plurality ofmanipulation regions may be set, and an operation corresponding to acombination of the manipulation regions which is manipulated may beperformed. The number of projection regions that are provided on thescreen SC, and operations that are set in correlation with theprojection regions are set in advance and are stored in the conditionstorage unit 173.

In addition, in a case where the manipulation detecting unit 127 canspecify an indication position of the indicator, an operation (function)of the projector 100 may be allocated with respect to a trajectory ofthe indication position. In addition, in a case where a plurality ofindicators having different shapes are used and the manipulationdetecting unit 127 can distinguish shapes of the indicators on the basisof the captured image data, an operation may be allocated incorrespondence with the shape of the indicator whose manipulation isdetected. In this case, when a manipulation is performed by theindicator, an operation corresponding to the shape of the indicator thatis used for the manipulation is performed. In addition, in a case wherethe indicator is the bright spot on the screen SC which is formed by thepointer or in a case where the indicator has a light-emitting function,an operation may be allocated in correlation with the number of times ofblinking of the bright spot or the indicator, a speed, a lighting time,a blinking pattern, and the like.

An operation that is performed in correspondence with the manipulationof the detection region is not limited to the source switching, and forexample, a projection control process such as enlargement, reduction,rotation, and movement, of the projection image on the screen SC may beallocated. In addition, a mute function of stopping projection of theimage during projection and also stopping an audio output may beallocated. In addition, the above-described operation may be anoperation of switching a single display in which an image based on imagedata of any of the input system IN1 and the input system IN2 isprojected, and a multi-display in which a plurality of images based onthe image data of the plurality of systems are arranged and areprojected onto the screen SC. In addition, an operation of turning offthe power of the projector 100, an operation of drawing a figure byfollowing the indication position of the indicator, an operation ofselecting and displaying image data stored in an external storage medium(not shown), and the like may be allocated.

The imaging control unit 128 (control unit) sets an image-capturingresolution in a case where the imaging unit 180 performsimage-capturing, and controls the imaging unit 180 to perform theimage-capturing. Here, the number of light-receiving elements that areprovided to the CCD camera 181 is determined in advance. According tothis, the imaging control unit 128 converts the captured image data thatis output from the CCD camera 181 to image data having a specificresolution, and stores the converted image data in the captured imagememory 182. In this case, the resolution of the captured image data thatis stored in the captured image memory 182 by the imaging control unit128 corresponds to the image-capturing resolution of the imaging unit180. In addition, captured image data having a resolution, which isdesignated by the imaging control unit 128 on the basis of a signaloutput from an imaging element of the CCD camera 181, may be generatedby a function of a peripheral circuit (not shown) provided to the CCDcamera 181. According to this method, the imaging control unit 128 canadjust the resolution of the captured image data obtained by performingthe image-capturing by the CCD camera 181 to an arbitrary resolution. Asan example, the imaging control unit 128 of this embodiment can settwo-stage image-capturing resolution including QVGA (320 pixels×240pixels) and VGA (640 pixels×480 pixels). A resolution which the imagingcontrol unit 128 can set is stored, for example, in the set valuestorage unit 172 of the ROM 170.

In a case where the correction control unit 122 performs the distortioncorrecting process, the imaging control unit 128 sets theimage-capturing resolution of the imaging unit 180 to a high-quality(high-resolution) VGA. In the distortion correcting process, in a casewhere a pattern for distortion correction or an external appearance ofthe projection image on the screen SC can be detected with highaccuracy, high-accuracy distortion correction can be performed, and thusthis case is preferable.

In addition, in a case where the manipulation detecting unit 127performs the manipulation detecting process, the imaging control unit128 sets the image-capturing resolution of the imaging unit 180 to QVGA.In the manipulation detecting process which is performed by themanipulation detecting unit 127, even in a low-resolution image, themanipulation of the indicator can be detected. In addition, when thelow-resolution image data is used, an amount of data that is processedbecomes small, and thus a processing load is small and the process canbe performed with high speed. Accordingly, there is an advantage thatthe manipulation of the indicator can be quickly detected.

The imaging control unit 128 utilizes one imaging unit 180, and thus theimaging control unit 128 performs control of switching an operationstate in which the correction control unit 122 performs the distortioncorrecting process and an operation state in which the manipulationdetecting unit 127 performs the manipulation detecting process, and theimaging control unit 128 sets image-capturing resolutions correspondingto the operation states in the imaging unit 180.

When the distortion correcting process by the correction control unit122 is performed in accordance with a relative position between theprojector 100 and the screen SC, if the relative position does not varyafter the performance, the distortion correcting process may not beperformed. According to this, the imaging control unit 128 performscontrol of detecting movement of the projector 100 by the movementdetecting unit 185 and switching the operation state. A description willbe given to this operation with reference to a flowchart.

FIG. 3 is a flowchart illustrating an operation of the projector 100.

The CPU 120 initiates projection of an image by control of theprojection control unit 121 in accordance with a manipulation of theremote controller 191 or the manipulation unit 195 (step S11).

After initiation of the projection, the correction control unit 122reads out parameters for correction, which have been used when theprojector 100 was used at an immediately previous time, from the ROM170, and performs trapezoidal distortion correction by using theparameters (step S12). In addition, the trapezoidal distortioncorrection may be performed by using predetermined parameters (initialset values) instead of the immediately previous parameters.

Then, the movement detecting unit 185 initiates movement detection (stepS13).

The imaging control unit 128 determines whether or not the projector 100has moved on the basis of an output from the movement detecting unit 185(step S14). In a case where the projector 100 is moving, or in a casewhere a predetermined time has not elapsed after the movement of theprojector 100 is stopped, the imaging control unit 128 determines thatthe projector 100 is moving. In a case where it is determined that theprojector 100 is moving (Yes in step S14), the imaging control unit 128determines whether or not switching of the operation state of theprojector 100 is completed (step S15). As described above, in a casewhere the movement of the projector 100 is detected, an operation state,in which the correction control unit 122 performs the distortioncorrecting process, is set. In step S15, the imaging control unit 128determines whether or not the operation state is already set to theoperation state in which the distortion correcting process is performed,or whether or not the operation state is an operation state in which themanipulation detecting unit 127 performs the manipulation detectingprocess.

In a case where the operation state of the projector 100 is not set tothe operation state in which the distortion correcting process isperformed (No in step S15), the imaging control unit 128 switches anoperation state to the operation state in which the distortioncorrecting process is performed. That is, projection of the image fordetection is stopped (step S16), the image-capturing resolution of theimaging unit 180 is set to VGA (step S17), and the imaging control unit128 transitions to step S18.

In addition, in a case where an operation state of the projector 100 isset to the operation state in which the distortion correcting process isperformed (Yes in step S15), the imaging control unit 128 transitions tostep S18.

In step S18, the imaging control unit 128 allows the imaging unit 180 toperform image-capturing. Continuously, the correction control unit 122newly calculates parameters for distortion correction on the basis ofthe captured image data of the imaging unit 180, and updates parametersthat are used by the trapezoidal distortion correction unit 132 (stepS19). The trapezoidal distortion correcting unit 132 performs thetrapezoidal distortion correcting process by using the updatedparameters (step S20).

The imaging control unit 128 determines whether or not operationcompletion of the projector 100 is instructed by the manipulation unit195 or the remote controller 191 (step S21). In a case where atermination instruction is given (Yes in step S21), the CPU 120 stopsprojection, and terminates this process (step S22). In addition, in acase where the termination instruction is not given (No in step S21),the process returns to step S14 to detect movement.

On the other hand, in a case where it is determined that the projector100 does not move (No in step S14), the imaging control unit 128determines whether or not the switching of the operation state of theprojector 100 is completed (step S23). In a case where the stopping ofthe projector 100 is detected, an operation state in which themanipulation detecting unit 127 performs the manipulation detectingprocess is set. In step S23, the imaging control unit 128 determineswhether or not an operation state is already set to the operation statein which the manipulation detecting process is performed or whether ornot an operation state is the operation state in which the distortioncorrecting process is performed.

In a case where the operation state of the projector 100 is not set tothe operation state in which the manipulation detecting process isperformed (No in step S23), the imaging control unit 128 switches theoperation state to an operation state in which the manipulationdetecting process is performed. That is, the imaging control unit 128sets the image-capturing resolution of the imaging unit 180 to QVGA(step S24), and as shown in FIGS. 2A to 2D, the manipulation detectingunit 127 performs control of projecting the image for detection onto thescreen SC (step S25), and transitions to step S26.

In addition, in a case where the operation state of the projector 100 isset to the operation state in which the manipulation detecting processis performed (Yes in step S23), the imaging control unit 128 transitionsto step S26.

In step S26, the manipulation detecting unit 127 allows the imaging unit180 to perform image-capturing (step S20), and analyzes the capturedimage data to detect a manipulation (step S27).

Here, the manipulation detecting unit 127 determines whether or not amanipulation corresponding to a condition that is set in advance hasbeen performed (step S28). In a case where it is determined that themanipulation corresponding to the condition has been performed (Yes instep S28), the manipulation detecting unit 127 performs an operationthat is set in correlation with the condition (step S29). For example,the manipulation detecting unit 127 performs the above-described sourceswitching and transitions to step S30.

In addition, in a case where it is determined by the manipulationdetecting unit 127 that the manipulation corresponding to the conditionthat is set in advance is not performed (No in step S28), themanipulation detecting unit 127 transitions to step S30 as is.

In step S30, the imaging control unit 128 determines whether or notoperation termination of the projector 100 is instructed by themanipulation unit 195 or the remote controller 191. In a case where thetermination instruction is given (Yes in step S30), the CPU 120transitions to step S22, and stops the projection and terminates thisprocess. In addition, in a case where the termination instruction is notgiven (No in step S30), it returns to step S14, and the manipulationdetecting process is continued.

In addition, the operation of the imaging control unit 128 is notlimited to the flow control shown in FIG. 3. The imaging control unit128 may initiate a determination on movement of the projector 100 instep S12, and may perform a determination corresponding to steps S16 andS24 by an interruption control at a point in time at which it isdetermined that movement of the projector 100 is stopped. In this case,in a case where the projector 100 moves or after the movement isstopped, the imaging control unit 128 can quickly switch the operationstate. In addition, this is also true of a case where the projectiontermination is instructed by the remote controller 191 or themanipulation unit 195. In addition, it is not limited to the flowcontrol shown in FIG. 3, and when the manipulation is detected, the sameprocess as step S27 may be performed by the interruption control.

As described above, the projector 100 includes the manipulationdetecting unit 127 that performs the manipulation detecting process ofdetecting the manipulation made on the projection surface on the basisof the captured image data, and the correction control unit 122 thatperforms the distortion correcting process on the basis of the capturedimage data. In addition, the projector 100 sets the image-capturingresolution of the imaging unit 180 to resolutions different from eachother between a case where the correction control unit 122 performs thedistortion correcting process and a case where the manipulationdetecting unit 127 performs the manipulation detecting process.According to this, it is possible to set the image-capturing resolutionof the imaging unit 180 to be suitable for the process that is performedon the basis of the captured image data, and thus a high-accuracyprocess based on the captured image data (image-capturing result) can beperformed. As a result, it is possible to suppress an increase in aprocessing load.

The imaging control unit 128 performs control of switching a firstoperation state in which the manipulation detecting process is performedby the manipulation detecting unit 127, and a second operation state inwhich the distortion correcting process is performed by the correctioncontrol unit 122. In addition, when switching the first operation stateand the second operation state, the imaging control unit 128 changes theimage-capturing resolution of the imaging unit 180. As described above,the operation state of the projector 100 is switched, and theimage-capturing resolution is changed in the switching. As a result, itis possible to perform any of the manipulation detecting process and thedistortion correcting process with a suitable resolution.

In addition, the manipulation detecting process that is performed by themanipulation detecting unit 127 includes a determination process ofdetermining whether or not a detected manipulation corresponds to amanipulation that is set in advance. The imaging control unit 128 setsthe image-capturing resolution of the imaging unit 180 in a case wherethe manipulation detecting unit 127 performs the manipulation detectingprocess at a resolution lower than a resolution in a case where thecorrection control unit 122 performs the distortion correcting process.According to this, it is possible to perform the manipulation detectingprocess at a high speed by using low-resolution captured image data. Inaddition, the distortion correcting process that is different from thedetermination process is performed on the basis of an image-capturingresult with a relatively high resolution, and thus it is possible toperform high-accuracy distortion correction.

In addition, the above-described embodiment is an example of a specificaspect to which the invention is applied, and the invention is notlimited to the embodiment, and the invention may be applied as adifferent aspect. For example, in the above-described embodiment, a casewhere an image based on input image data is projected by switching aplurality of input systems IN1 and IN2 which are input to the I/F 110has been described as an example. That is, an example in which the I/F110 switches the input system IN1 and the input system IN2 incorrespondence with the manipulation detected by the manipulationdetecting unit 127 has been described. However, the invention is notlimited thereto, and a configuration, in which image data input to theI/F 110 and image data stored in the ROM 170 are switched and projected,is possible. In addition, image data stored in an external storagedevice that is connected to the projector 100 may be used.

In addition, the process that is set in advance is not limited to thesource switching process of switching the input systems IN1 and IN2 ofthe I/F 110. For example, as the process that is set in advance, aprocess of performing the above-described mute function and thentemporarily stopping an output of an image of the projector 100 or animage and a voice of the projector 100, or a process of restarting theoutput may be performed. In addition, an electronic zooming process ofenlarging or reducing an image that is drawn by the optical modulator130, a process of controlling the volume of the voice output from theprojector 100, and the like may be performed.

In addition, in the above-described embodiment, as an example, adescription has been given to a configuration in which the manipulationdetecting unit 127 determines that a manipulation by the indicator 2 hasoccurred in a case where brightness of the image 63 for detection in thecaptured image data varies, and the manipulation detecting unit 127performs the source switching. That is, the configuration is an examplein which the source switching is performed in a case where the indicator2 is overlapped on the image 63 for detection. The invention is notlimited to the example, and the manipulation detecting unit 127 maydetermine that a manipulation by the indicator 2 has occurred in a casewhere the brightness of the image 63 for detection in the captured imagedata varies and the brightness returns to an original state. That is, aconfiguration, in which a process set in advance is performed when theindicator 2 overlapped on the image 63 for detection on the screen SC isspaced away from the image 63 for detection, is possible.

In addition, in the above-described embodiment, set values relating to atime at which the operation of each of the units of the projector 100 isdefined, and a threshold value are stored in advance in the ROM 170, butthe invention is not limited thereto. A configuration, in which theabove-described set values are stored in a storage medium or a storagedevice outside the projector 100, and the set values are acquired by theprojector 100 as necessary, is possible. In addition, a configuration,in which the set values are input whenever a manipulation by the remotecontroller 191 or the manipulation unit 195 is made, is possible.

In addition, in the above-described embodiment, a description has beengiven to a configuration in which the projection unit 101 and theimaging unit 180 are fixed to the main body of the projector 100, butthe projection unit 101 and the imaging unit 180 may be configured as aseparate unit from the main body of the projector 100. In addition, inthe above-described embodiment, a description has been given to a casewhere the correction control unit 122 corrects the trapezoidaldistortion of the projection image. However, for example, a process ofcorrecting distortion called barrel distortion or spool distortion maybe performed.

In addition, in the above-described embodiment, a description has beengiven to a configuration in which the imaging unit 180 includes the CCDcamera 181 including the CCD image sensor, but a CMOS sensor may be usedas the image sensor. In addition, in the above-described embodiment, adescription has been given to a configuration in which three sheets oftransmissive liquid crystal panels corresponding to respective colors ofRGB are used as the optical modulator, but reflective liquid crystalpanels may be used. In addition, for example, the optical modulator maybe configured as a type in which one sheet of liquid crystal panel and acolor wheel are combined, a type in which three sheets of digital mirrordevices (DMDs) that modulate colored light beams of respective colors ofRGB are used, a type in which one sheet of digital mirror device and acolor wheel are combined, and the like.

In addition, the respective functional units that are shown in FIG. 1represent functional configurations of the projector 100, and a specificmounting aspect is not particularly limited. That is, it is notnecessary for hardware individually corresponding to each of thefunctional units to be mounted, and a configuration, in which functionsof a plurality of functional units are realized by executing a programby one processor, is also possible. In addition, in the above-describedembodiment, parts of functions which are realized by software may berealized by hardware, and parts of functions which are realized byhardware may be realized by software.

What is claimed is:
 1. A projector, comprising: an imaging unit whichcaptures an image of a projection surface; a first processing unit whichdetects a manipulation performed on the projection surface on a basis ofan image-capturing result of the imaging unit, and performs a firstprocess corresponding to the manipulation that is detected; a secondprocessing unit which performs a second process different from the firstprocess on the basis of the image-capturing result of the imaging unit;and a control unit which sets an image-capturing resolution of theimaging unit to resolutions different from each other between a casewhere the first processing unit performs the first process, and a casewhere the second processing unit performs the second process, theimage-capturing resolution being a number of pixels used to capture animage, wherein the second process that is performed by the secondprocessing unit includes a process of correcting distortion of aprojection image that is projected onto the projection surface, whereinthe first process that is performed by the first processing unitincludes a determination process of determining whether or not anindication manipulation detected in a detection process corresponds to amanipulation that is set in advance, and the control unit sets theimage-capturing resolution of the imaging unit in a case where the firstprocessing unit performs the first process at a resolution lower than aresolution in a case where the second processing unit performs thesecond process.
 2. The projector according to claim 1, wherein thecontrol unit performs control of switching a first operation state inwhich the projector performs the first process by the first processingunit, and a second operation state in which the projector performs thesecond process by the second processing unit, and when the firstoperation state and the second operation state are switched to eachother, the image-capturing resolution of the imaging unit is changed. 3.The projector according to claim 1, wherein the first process that isperformed by the first processing unit includes a detection process ofdetecting an indication manipulation on the projection surface.
 4. Amethod of controlling a projector, comprising: controlling a projectorincluding an imaging unit that captures an image of a projectionsurface; and setting an image-capturing resolution of the imaging unitto resolutions that are different from each other between a case ofdetecting a manipulation performed on the projection surface on a basisof an image-capturing result of the imaging unit and performing a firstprocess corresponding to the manipulation that is detected, and a caseof performing a second process different from the first process on thebasis of the image-capturing result of the imaging unit, theimage-capturing resolution being a number of pixels used to capture animage, wherein the second process that is performed includes a processof correcting distortion of a projection image that is projected ontothe projection surface, wherein the first process includes adetermination process of determining whether or not an indicationmanipulation detected in a detection process corresponds to amanipulation that is set in advance, and setting the image-capturingresolution of the imaging unit in a case where the first process isperformed at a resolution lower than a resolution at which the secondprocess is performed.
 5. The projector according to claim 1, furthercomprising detecting with a movement detection unit whether or not theprojector has moved within a predetermined time period, whereindetection of the manipulation performed on the projection surface on abasis of an image-capturing result of the imaging unit, and performing afirst process corresponding to the manipulation that is detected isperformed in response to the movement detection unit not detectingmovement of the projector within the predetermined time period, andperforming a second process different from the first process on thebasis of the image-capturing result of the imaging unit is performed inresponse to the movement detection unit detecting movement of theprojector within the predetermined time period.
 6. The method ofcontrolling a projector according to claim 4, further comprisingdetecting whether or not the projector has moved within a predeterminedtime period, wherein detection of the manipulation performed on theprojection surface on a basis of an image-capturing result of theimaging unit, and performing a first process corresponding to themanipulation that is detected is performed in response to the movementdetection unit not detecting movement of the projector within thepredetermined time period, and performing a second process differentfrom the first process on the basis of the image-capturing result of theimaging unit is performed in response to the movement detection unitdetecting movement of the projector within the predetermined timeperiod.